Skip to content

Conversation

malte-aws
Copy link

Description

Documentation for PR that adds exposes cache token usage in metric.

Type of Change

  • New content addition

Motivation and Context

My customer was asking about the cache token usage.

Areas Affected

  • observability-evaluation/metrics.md
  • concepts/model-providers/custom_model_provider.md

Screenshots

Checklist

  • I have read the CONTRIBUTING document
  • My changes follow the project's documentation style
  • I have tested the documentation locally using mkdocs serve
  • Links in the documentation are valid and working
  • Images/diagrams are properly sized and formatted
  • All new and existing tests pass

Additional Notes

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant